CONTENT AND TASK-EXECUTION SERVICES 
PROVIDED THROUGH DIALOG-BASED INTERFACES 



BACKGROUND OF THE INVENTION 
The present invention generally pertains to 
a method for providing content and/or task-execution 
services to a user. More particularly, the present 
invention pertains to a method for providing content 
and/or task-execution services based on a user's 
dialog-based communication with a communication 
service accessed through any of a variety of 
interfaces . 

There are known systems that enable a user 
to interact with a server to retrieve information, or 
to remotely perform a task. The typical known 
system, however, reguires a user to utilize 
specialized software that is maintained on the user's 
client machine. The software typically operates in 
association with its own user interface, which is not 
always user-friendly, and often reguires familiarity 
with a relatively complex collection of specialized 
command words. As the client-side software is 
updated or expanded upon, all copies must be updated. 
If a user purchases a new device, a new copy of the 
client-side software must be obtained, installed, and 
in many cases re-configured. The client-side 

software generally takes up memory space on every 
device utilized to interact with the server. This 
use of space is of concern, especially for devices, 
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such as cell phones and mobile computing devices, 
which can have a relatively limited storage capacity. 

In many instances, client-side software 
utilized to interact with a server varies 
5 dramatically from one device to another. For 
example, the user interface can be significantly 
inconsistent from one computing device to the next. 
Presently, it is relatively difficult for a user to 
efficiently interact with a server to access content, 
10 or to remotely perform a task, when the user does not 
have access to a personal computer. There is a need 
for a consistent client interface that provides a 
relatively standard way to interact with a server 
regardless of the size or mobility of a given 
15 computing device. 

Finally, it is not uncommon for users to be 
required to load and interact with multiple user 
interfaces to accomplish multiple server 
interactions. For example, a first user interface 
20 might be required to pay a bill, a second to retrieve 
sports-related content, and a third to edit a 
calendar-based schedule. There is a need for a 
single intuitive interface that can be utilized to 
effectuate transactions across multiple applications 
25 that would traditionally be accessed through separate 
and independent user interfaces. 



SUMMARY OF THE INVENTION 
Embodiments of the present invention 
30 generally pertain to a client-server interaction 
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scheme that enables content to be retrieved, or a 
task to be executed, through user instructions 
embedded in dialog-based user communication with a 
specialized simulated entity. Generally speaking, 
5 the scheme involves communication between a user 
device having a dialog-based user interface and a 
communication service provider, the communication 
typically taking place over some form of a network. 
In accordance with one aspect of the present 

10 invention, a user utilizes traditional, dialog-based, 
person-to-person type interaction to request and 
receive information from a non-human source. The 
user interacts with the non-human source in a manner 
substantially similar to how they would typically 

15 interact with another person. The user interactions 
are analyzed and translated into calls not only for 
informational content, but also calls for action to 
be taken on behalf of the user. 

20 BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a schematic block diagram of an 
exemplary computing environment. 

FIG. 2 is a block diagram of an exemplary 
computing environment. 
25 FIG. 3 is a simplified pictorial 

illustration of a mobile device. 

FIG. 4 is a simplified pictorial 
illustration of a mobile device. 

FIG. 5 is a schematic block diagram 
30 representing a dialog-based content retrieval system. 
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FIG. 6 is a schematic block diagram 
representing a dialog-based content retrieval system. 

FIG. 7 is an illustration of an exemplary 
screen shot. 

5 FIG. 8 is an illustration of an exemplary 

screen shot. 

FIG. 9 is an illustration of an exemplary 

screen shot. 

FIG. 10 is a schematic block diagram 
10 representing a dialog-based task execution system. 

FIG. 11 is a schematic block diagram 
illustrating a dialog-based task-execution system. 

FIG. 12 is a flow chart representing steps 
associated with retrieving content utilizing a 
15 dialog-based system. 

FIG. 13 is a flow chart representing steps 
associated with executing a subscription-oriented, 
dialog-based content retrieval system. 

FIG. 14 is a flow chart representing steps 
20 associated with task-execution utilizing a dialog- 
based system. 

DETAILED DESCRIPTION OF ILLUSTRATIVE EMBODIMENTS 

25 I. A Mobile Environment 

For the purpose of providing a context for 
the description of the present invention, a few 
specific computing system environments within which 
embodiments of the present invention are applicable 

30 will be described. However, the present invention is 
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operational with numerous general purpose or special 
purpose computing systems, as well as various 
networked configurations thereof. Examples of well- 
known computing systems, environments, and/or 
5 configurations that are suitable to accommodate 
embodiments of the present invention include, but are 
not limited to, personal computers, server computers, 
hand-held or laptop devices, multiprocessor systems, 
microprocessor-based systems, set top boxes, 

10 programmable consumer electronics, network PCs, 
minicomputers, mainframe computers, telephone 
systems, distributed computing environments that 
include any of the above systems or devices, and any 
networked configurations thereof. 

15 Further, the present invention may be 

described in the general context of computer- 
executable instructions, such as program modules, 
being executed by a computer. Generally, program 
modules include routines, programs, objects, 

20 components, data structures, etc. that perform 
particular tasks or implement particular abstract 
data types. The invention may also be practiced in 
distributed computing environments where tasks are 
performed by a remote processing devices that are 

25 linked through a communications network. In a 
distributed computing environment, program modules 
may be located in local and/or remote storage media 
including memory storage devices. 

FIG. 1 is a block diagram of an 

30 illustrative environment 10 within which embodiments 
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of the present invention can be implemented. 
Environment 10 includes a mobile device 12 and a 
communication service provider 14. Communication 
service provider 14 includes application programs 28, 
5 a memory 32, a server subsystem 29 and a 
communication link 38. Mobile device 12 includes 
application programs 16, a program memory 20 and 
communication link 26. Mobile device 12 also 
includes memory 58, microprocessor 56, operating 

10 system 64, input /output (I/O) components 60 and 
communication drivers 66. Components of mobile 
device 12 are illustratively coupled for 
communication with one another over a suitable buss 
62. It will be appreciated that both mobile device 

15 12 and computing device 14 include a number of other 
non-illustrated components. 

Referring to mobile device 12, memory 58 is 
preferably implemented as non-volatile electronic 
memory such as random access memory (RAM) with a 

20 battery back-up module (not shown) such that 
information stored in memory 58 is not lost when the 
general power to mobile device 12 is shut down. A 
portion of memory 58 is illustratively allocated as 
addressable memory for program execution, while 

25 another portion of memory 58 is optionally used for 
storage, such as to simulate storage on a disc drive. 
Memory 58 includes operating system 64, as well as 
one or more application programs 16 and corresponding 
memory structure 20. Application programs 16 may 

30 illustratively include a program (e.g., a GPS 
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program) that is configured to identify a location of 
mobile device 12, such as location within a 
geographical coordinate system (e.g., 

latitude/longitude coordinates) . 
5 Operating system 64 is executed during 

operation by processor 56 from memory 58. The 
operating system 64 implements features that can be 
utilized by application programs 16 through a set of 
exposed application programming interfaces and 

10 methods. I/O components 60, in one embodiment, are 
provided to facilitate input and output operations in 
association with a user of mobile device 12. I/O 
components 60 for various embodiments of mobile 
device 12 can include input components such as 

15 buttons and touch sensors, as well as output 
components such as a display, a speaker, and/or a 
printer port. Other I/O components are conceivable 
and within the scope of the present invention. 

Communication link 26 can be any of a 

20 variety of known suitable communication interfaces. 
The function of link 26 is generally to enable 
communication with communication service provider 14 
through network 27. Network 27 can be any of a 
variety of known communications networks including 

25 but not limited to the Internet and a cellular 
communications network. Memory 58 includes a set of 
communication drivers 66 that interact with 
communication link 26, and that translate data to and 
from the appropriate communication protocol necessary 
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to enable communication across the link 26 through 
network 27. 

In one illustrative embodiment of the 
present invention, application programs 16 include 
5 one or more dialog-based communication programs such 
as, but not limited to an email application, an 
instant messaging application and/or an SMS (Short 
Message Service) application. Communication service 
provider 14 is configured to support the dialog-based 

10 communication programs as they are executed by a user 
of mobile device 12. The dialog-based communication 
programs enable a user of mobile device 12 to 
communicate with at least one other individual 
through a dialog-based interface (e.g., an email 

15 interface, a chat message interface, etc.) As will 
be explained in detail in relation to other Figures, 
in accordance with one aspect of the present 
invention, a user of device 12 communicates with a 
computer simulated "person" through dialog-based 

20 communication. Through this dialog-based 

communication, the user of device 12 makes calls to 
server subsystem 29 for specialized content and/or 
action to be carried out. In this manner, the 
simulated "person" essentially can deliver requested 

25 content to the user and/or perform tasks on behalf of 
the user. 

Application programs 16 may also include 
Personal Information Manager (PIM) programs, which 
support, for example, electronic mail messaging, 
30 scheduling, calendering, personal accounting, 
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automatic bill paying, etc. Of course, application 
programs 16 can include other applications configured 
to support any of a wide variety of other program 
features, such as task lists and personalized address 
5 books, to name a few. Memory 20 is configured to 
store a plurality of individual records or objects, 
each comprising a plurality of fields or properties 
related to application programs 16. 

Application programs 28 can include any of 

10 a variety of conventional features and functions. 
Application programs 28 include programs designed to 
support programs 16 such as a server-side email 
program, an instant messaging program and/or an SMS 
program. Application programs 28 can also include 

15 programs designed to be remotely utilized by an 
operator of mobile device 12 to manage personal data. 
Such programs can include PIM programs, which 
support, for example, electronic mail messaging, 
scheduling, calendaring, personal accounting and 

20 financing, task listing, address booking, making 
travel arrangements, automatic bill paying, etc. Of 
course, application programs 28 can include other 
applications configured to support any of a wide 
variety of other program features. 

25 In accordance with one aspect of the 

present invention, when a user of mobile device 12 
interacts with a simulated "person" as described 
above, server subsystem 29 is directed to interact 
with a PIM program, or other program remotely 

30 accessed or in programs 28 or 16, on the user's 
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behalf . In this manner, the simulated "person" 
essentially enables the user to perform a program 
task without directly accessing the program's 
particular user interface. The simulated person can 
5 perform any of a variety of functions for the user, 
such as adding a date to a calendar, canceling a 
flight reservation, paying a bill, etc. Memory 32 is 
configured to store a plurality of individual records 
or objects, each comprising a plurality of fields or 

10 properties related to the application programs. A 
user can interact with the simulated "person" to have 
server subsystem 29 deliver content to device 12. 
The content delivered to the user through device 12 
may be the user's data stored in memory 32, or may be 

15 content that originates from a third-party source 
(e.g., ESPN, MSNBC, etc.). These simulated 

"person" systems will be described below in detail in 
relation to other Figures. 

Communication service provider 14 and 

20 mobile device 12 communicate with each other through 
two-way communication links 26 and 38. Communication 
links 26 and 38 are illustratively commercially 
available communication links that implement a 
suitable communications protocol. For example, in a 

25 direct connection embodiment, mobile device 12 is 
connected to communication service provider 14 with a 
physical cable that communicates utilizing a serial 
communication protocol. Other communication 
mechanisms are also contemplated by the present 

30 invention, such as but not limited to infra-red (IR) 
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communication, direct modem communication, remote 
dial-up-networking communication, communication 
through commercially available network cards (e.g., 
using TCP/IP), remote access services (RAS) , wireless 
5 modem communication, wireless cellular digital packet 
data (CDPD) , wireless Bluetooth™ communication, 
FireWire communication, or any other suitable 
communication mechanism or means. Although the 
communication links are shown as being internal to 

10 mobile device 12 and communication service provider 
14, those skilled in the art will recognize that at 
least portions of the communication links may exist 
outside of the devices. 

It should be noted that devices 12 and 14 

15 are only examples of devices suitable to support the 
present invention and are not intended to suggest any 
limitation as to the scope of use or functionality of 
the present invention. Neither should devices 12 and 
14 be interpreted as having any dependency or 

20 requirement relating to any one or combination of 
components illustrated in FIG. 1. 

II. A Personal Computer Environment 

FIG. 2 is a block diagram of an exemplary 

25 computing environment within which embodiments of the 
present invention can be implemented. The Figure 
presents a general-purpose computing device in the 
form of a computer 110. Computer 110 is 

illustratively configured to generally operate as 

30 either of devices 12 and 14 described in relation to 
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FIG. 1, but is particularly well suited to operate in 
place of mobile device 12. Computer 110 can be 
configured to operate the same as, and perform any of 
the described functions of, mobile device 12. 
5 Components of computer 110 may include, but 

are not limited to, a processing unit 120, a system 
memory 130, and a system bus 121 that couples various 
system components including the system memory to the 
processing unit 120. The system bus 121 may be any 

10 of several types of bus structures including a memory 
bus or memory controller, a peripheral bus, and a 
local bus using any of a variety of bus 
architectures. By way of example, and not 

limitation, such architectures include Industry 

15 Standard Architecture (ISA) bus, Micro Channel 
Architecture (MCA) bus, Enhanced ISA (EISA) bus, 
Video Electronics Standards Association (VESA) local 
bus, and Peripheral Component Interconnect (PCI) bus 
also known as Mezzanine bus. 

20 Computer 110 typically includes a variety 

of computer readable media. Computer readable media 
can be any available media that can be accessed by 
computer 110 and includes both volatile and 
nonvolatile media, removable and non-removable media. 

25 By way of example, and not limitation, computer 
readable media may comprise computer storage media 
and communication media. Computer storage media 
includes both volatile and nonvolatile, removable and 
non-removable media implemented in any method or 

30 technology for storage of information such as 
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computer readable instructions, data structures, 
program modules or other data. Computer storage 
media includes, but is not limited to, RAM, ROM, 
EEPROM, flash memory or other memory technology, CD- 
ROM, digital versatile disks (DVD) or other optical 
disk storage, magnetic cassettes, magnetic tape, 
magnetic disk storage or other magnetic storage 
devices, or any other medium which can be used to 
store the desired information and which can be 
accessed by computer 110. Communication media 
typically embodies computer readable instructions, 
data structures, program modules or other data in a 
modulated data signal such as a carrier wave or other 
transport mechanism and includes any information 
delivery media. The term "modulated data signal" 
means a signal that has one or more of its 
characteristics set or changed in such a manner as to 
encode information in the signal. By way of example, 
and not limitation, communication media includes 
wired media such as a wired network or direct -wired 
connection, and wireless media such as acoustic, RF, 
infrared and other wireless media. Combinations of 
any of the above should also be included within the 
scope of computer readable media. 

The system memory 130 includes computer 
storage media in the form of volatile and/or 
nonvolatile memory such as read only memory (ROM) 131 
and random access memory (RAM) 132. A basic 
input/output system 133 (BIOS), containing the basic 
routines that help to transfer information between 
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elements within computer 110 , such as during start- 
up, is typically stored in ROM 131. RAM 132 
typically contains data and/or program modules that 
are immediately accessible to and/or presently being 
5 operated on by processing unit 120. By way of 
example, and not limitation, FIG. 2 illustrates 
operating system 134, application programs 135, other 
program modules 136, and program data 137. 

The computer 110 may also include other 

10 removable /non-removable volatile /nonvolatile computer 
storage media. By way of example only, FIG. 2 
illustrates a hard disk drive 141 that reads from or 
writes to non-removable, nonvolatile magnetic media, 
a magnetic disk drive 151 that reads from or writes 

15 to a removable, nonvolatile magnetic disk 152, and an 
optical disk drive 155 that reads from or writes to a 
removable, nonvolatile optical disk 156 such as a CD 
ROM or other optical media. Other removable/non- 
removable, volatile/nonvolatile computer storage 

20 media that can be used in the exemplary operating 
environment include, but are not limited to, magnetic 
tape cassettes, flash memory cards, digital versatile 
disks, digital video tape, solid state RAM, solid 
state ROM, and the like. The hard disk drive 141 is 

25 typically connected to the system bus 121 through a 
non-removable memory interface such as interface 140, 
and magnetic disk drive 151 and optical disk drive 
155 are typically connected to the system bus 121 by 
a removable memory interface, such as interface 150. 
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The drives and their associated computer 
storage media discussed above and illustrated in FIG. 
2, provide storage of computer readable instructions, 
data structures, program modules and other data for 
the computer 110. In FIG. 2, for example, hard disk 
drive 141 is illustrated as storing operating system 
144, application programs 145, other program modules 
146, and program data 147. Note that these 

components can either be the same as or different 
from operating system 134, application programs 135, 
other program modules 136, and program data 137. 
Operating system 144, application programs 145, other 
program modules 146, and program data 147 are given 
different numbers here to illustrate that, at a 
minimum, they are different copies. 

A user may enter commands and information 
into the computer 110 through input devices such as a 
keyboard 162, a microphone 163, and a pointing device 
161, such as a mouse, trackball or touch pad. Other 
input devices (not shown) may include a joystick, 
game pad, satellite dish, scanner, or the like. 
These and other input devices are often connected to 
the processing unit 120 through a user input 
interface 160 that is coupled to the system bus, but 
5 may be connected by other interface and bus 
structures, such as a parallel port, game port or a 
universal serial bus (USB) . A monitor 191 or other 
type of display device is also connected to the 
system bus 121 via an interface, such as a video 
30 interface 190. In addition to the monitor, computers 
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may also include other peripheral output devices such 
as speakers 197 and printer 196, which may be 
connected through an output peripheral interface 195. 

The computer 110 may operate in a networked 
5 environment using logical connections to one or more 
remote computers, such as a remote computer 180, 
which can include mobile device 12. The remote 
computer 180 may be a personal computer, a hand-held 
device, a server, a router, a network PC, a peer 

10 device or other common network node, and typically 
includes many or all of the elements described above 
relative to the computer 110. The logical 

connections depicted in FIG. 2 include a local area 
network (LAN) 171 and a wide area network (WAN) 173, 

15 but may also include other networks. Such networking 
environments are commonplace in offices, enterprise- 
wide computer networks, intranets and the Internet. 
In addition, the network connections between any of 
the nodes in the network may include direct cable 

20 connections or wireless connections and the 
connection between computer 110 and remote computer 
180 may include any number of nodes and/or routers. 

When used in a LAN networking environment, 
the computer 110 is connected to the LAN 171 through 

25 a network interface or adapter 170. When used in a 
WAN networking environment, the computer 110 
typically includes a modem 172 or other means for 
establishing communications over the WAN 173, such as 
the Internet. The modem 172, which may be internal 

30 or external, may be connected to the system bus 121 



-17- 

via the user input interface 160, or other 
appropriate mechanism. In a networked environment, 
program modules depicted relative to the computer 

110, or portions thereof, may be stored in the remote 
5 memory storage device. By way of example, and not 

limitation, FIG. 2 illustrates remote application 
programs 185 as residing on remote computer 180. It 
will be appreciated that the network connections 
shown are exemplary and other means of establishing a 
10 communications link between the computers may be 
used. 

111. Examples of Mobile Device 12 

A mobile device 12 was described in 

15 relation to FIG. 1. In order to provide context for 
the embodiments of the present invention, a few 
specific examples of mobile devices configured to 
operate as the depicted device 12 are described 
immediately hereafter. 

20 FIG. 3 is a simplified pictorial 

illustration of one embodiment of a specific mobile 
device 12. Mobile device 12, as shown in FIG. 3, 
includes a screen 302 that can sense the position of 
stylus 304 relative to the screen and thereby allow 

25 the user to select objects on the screen, as well as 
write and draw through screen input. The mobile 
device 12 shown in FIG. 3 also includes a number of 
user input keys or buttons, such as button 320, which 
allow the user to scroll through menu options or 

30 other display options which are displayed on display 
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302, or which allow the user to change applications 
or select user input functions, without contacting 
display 302. 

It should be noted that display 302 will 
5 typically be much smaller than a conventional display 
used with a desktop computer. For example, display 
302 may be defined by a matrix of only 240X320 
coordinates or 160X160 coordinates, or any other 
suitable size. It is conceivable that mobile device 

10 12 could be a pager, and in such case, the display 
may be even smaller than described. 

Although not illustrated, the mobile device 
12 of FIG. 3 also includes an antenna that supports 
wireless communication with the device. Also 

15 included are one or more communication ports, such as 
a serial or USB port, or a Local Area Network (LAN) 
port, that support wired communication. 

The mobile device 12 of FIG. 3 is 
illustrated with a dialog-based instant messaging 

20 application operating thereon. Device 12 is 

illustratively configured to interact with an instant 
message server (e.g., communication service provider 
14 in FIG. 1) to enable instant message 
functionality, as is known in the art. Mobile device 

25 12 could just as easily be configured to interact 
with an email transport system to enable email 
functionality, or with an SMS system to enable SMS 
messaging. These are just several examples of 
dialog-based interfaces for which mobile device 12 

30 can be configured. 
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It should be noted that the specific 
content illustrated on display 302 is consistent with 
at least one aspect of the present invention. The 
content demonstrates an instant messaging 
5 conversation between a user of device 12 and a 
simulated "person". The user is interacting with the 
simulated person in order to initiate a retrieval of 
content. The user is effectively utilizing the 
simulated "person" to instruct server subsystem 29 

10 (FIG. 1) to retrieve content. The content is 
illustratively delivered through the simulated 
"person" format. These aspects of the present 
invention will be discussed below in detail in 
relation to other Figures. 

15 Fig. 4 provides a pictorial diagram of a 

phone embodiment of a mobile device 12. The phone 
includes a set of keypads 400 for dialing phone 
numbers, a display 402 capable of displaying 
application images, and control buttons 404 for 

20 selecting items shown on the display. The phone 
includes an antenna 4 06 for receiving and sending 
cellular phone signals such as General Packet Radio 
Service (GPRS) and lXrtt, and Short Message Service 
(SMS) signals. When operating in association with a 

25 cellular phone signal, the phone establishes a 
connection with a carrier. Generally, the carrier 
charges a fee based on the length of time that this 
connection is maintained. 

The phone of FIG. 4 is illustratively 

30 configured to support some form of textual dialog- 
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based communication including but not limited to 
instant messaging, text messaging and/or email. Such 
communication is illustratively supported by a 
remotely accessed communication service provider 
5 (e.g., service provider 14 in FIG. 1). A user of the 
phone can illustratively utilize these textual 
communication means to interact with a simulated 
"person" as described above. 

Another form of dialog-based communication 

10 for which phone 12 is configured is traditional 
speech communication. In accordance with one aspect 
of the present invention, a user of phone 12 can 
utilize traditional speech communication dialog in 
association with a specialized phone call system to 

15 request content and/or the performance of services. 
For example, communication service provider 14, which 
illustratively incorporates the specialized phone 
call system, is accessed by phone 12 through a 
conventional or cellular telephone network. The user 

20 interacts with a simulated or real person through 
traditional, dialog-based, telephone speech 

interaction. The system can also, or alternatively, 
be configured for interaction with the user based on 
non-speech input such as, but not limited to, touch- 

25 tone item selection, as is known in the art. 

It should be noted that devices other than 
those specifically described herein are possible and 
within the scope of the present invention. Other 
examples include tablet PCs and wireless-enabled lap- 

30 top computers. 
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IV. Overview of Dialog-Based Content Retrieval 

One aspect of the present invention 
pertains to the delivery of content to a user based 
5 on interaction with a dialog-based interface. 
Dialog-based interaction is illustratively, though 
not restricted to, communication that is 
traditionally associated with person-to-person 
interactions. Dialog-based interaction includes, but 

10 is not limited to, instant message interaction, SMS 
messaging interaction, other chat-based interaction, 
email interaction, and telephone speech interaction. 

Generally speaking, dialog-based 

interaction involves communication between a user 

15 device having a dialog-based interface and a 
communication service provider, typically over some 
form of a network. The communication service 

provider facilitates dialog-based communication 
between two users by facilitating communication 

20 between a first user device and a second user device. 
The basic idea is for a first user to use dialog to 
communicate with a second user. 

In accordance with one aspect of the 
present invention, a user utilizes traditional, 

25 dialog-based interaction to request and receive 
information from a non-human source. The user 
interacts with the non-human source in a manner 
substantially similar to how they would typically 
interact with another person. One benefit of such an 

30 information retrieval system is that the 
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inf rastructure required to support such a dialog- 
based content retrieval system is essentially limited 
to the server side. The retrieval system requires 
little or no changes to be made to client devices and 
5 traditional systems for dialog-based interaction. 

FIG. 5 is a schematic block diagram 
illustrating a dialog-based content retrieval system 
500. Numerous user devices suitable for the present 
invention were described in relation to FIGS. 1-4. A 

10 representative few are illustrated in FIG. 5, namely, 
PC clients 502, PDA clients 504, wireless clients 506 
(e.g., cell phones), and regular telephones 508. 
Devices 502, 504, 506 and 508 are all illustratively 
configured to interact with communication service 

15 provider 510 over a suitable and corresponding 
network 512. 

The precise nature of communication service 
provider 510 will depend at least upon the nature of 
a given dialog-based interaction system. For 

20 example, instant message interaction will utilize an 
instant message service provider, as is known in the 
art. Email interaction will utilize an email 
transport service provider, as is known in the art. 
An SMS service provider will be utilized to support 

25 SMS interaction, as is known in the art. A 
specialized call service provider will support 
conventional telephone interaction, as is known in 
the art. Communication service provider 510 can 
illustratively be configured to support any type of 
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dialog-based interaction and even multiple types of 
dialog-based interactions. 

The nature of network 512 is variable and 
is partially dependent at least upon the nature of a 
5 given user device. For example, devices 502, 504 and 
506 can be configured to communicate with service 
provider 510 over most networks including, but not 
limited to, a wireless network, the Internet, as well 
as any of the network configurations described in 
10 relation to FIGS. 1-4. Telephones 508 are 

illustratively configured to communicate with service 
provider 510 over an appropriate telephone network, 
as is known in the art. 

Communication service provider 510 is 
15 illustratively further configured to enable a user of 
one of devices 502, 504, 506 or 508 to utilize 
traditional dialog-based interaction to communicate 
with, and make a request for content to, a non-human 
source. In accordance with one embodiment, the non- 
20 human source appears on an instant message >x buddy 
list' 7 and the user is able to dialog with the non- 
human source in the same manner that the user would 
dialog with another person. In accordance with 
another embodiment, the user is able to participate 
25 in a text message dialog with the non-human source. 
In accordance with another embodiment, the user 
dialogs with an automated system over telephone 508 
in a manner that is similar to how the user would 
dialog with another person. 
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In accordance with one aspect of the 
present invention, in order to identify and fulfill 
requests for content, communication service provider 
510 is configured to analyze messages directed to the 
5 non-human source and identify strings that represent 
commands. An example of an appropriate command 
language will be discussed below in Section V. 
identified commands are directed to a content server 
516, which is illustratively responsible for 

10 compiling the requested content. In accordance with 
one embodiment, third party content providers 514 are 
configured to fill requests for content from content 
server 516 (e.g., XML feeds are supported between 
provider 514 and server 516) . 

15 FIG. 12 is a flow chart illustrating the 

process of a user utilizing a dialog-oriented system 
to access information. In accordance with block 
1202, a user dialogs with a non-human source and 
makes a request for information (e.g., a request for 

20 a particular sports score) . In accordance with block 
1204, the request is directed to content server 516. 
In accordance with block 1206, a corresponding 
request is made to a content provider 514 (e.g., an 
ESPN content provider) . In block 1208, content 

25 provider 514 sends appropriate information to content 
server 516. The information is then forwarded back 
to the user to fulfill the request. In accordance 
with one embodiment, the content is presented to the 
user within a dialog response from the non-human 

30 source back to the user. It should be noted that not 
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all content need come from a provider. Some or all 
content could just as easily be stored with content 
server 516, and be directly retrieved. 

In accordance with one embodiment, users 
are allowed access to certain content (e.g., certain 
content providers, or certain types of content like 
traffic information, sports score, etc.) on a 
subscription basis. FIG. 13 is a flow chart 

illustrating a process of extending a user's access 
on a subscription basis. Generally speaking, when a 
user asks the non-human source for content for which 
the user has no authorization (block 1302), the non- 
human source is configured to offer to sell the user 
extended content access (block 1304). A user's 
profile and billing information is illustratively 
maintained with communication service provider 510. 
Appropriate billing information can be maintained 
with the user's profile information. The user might 
be billed on a per access basis (e.g., $5 for 50 
searches), on an access-oriented basis (e.g., $5 per 
new content provider 514), or otherwise. In 
accordance with block 1306, the user is provided with 
the requested content only if he/she agrees to the 
additional fee. In accordance with one embodiment, a 
user may be provided with free access for a limited 
time, or for a limited number of searches, to "try 
out" certain services. After the limitations have 
expired, the user illustratively must pay or be 
denied further access. 
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In accordance with one embodiment, the 
content provided to a user is tailored to reflect 
certain parameters established in a profile 
maintained for that particular user. For example a 
5 request for weather information can be tailored to 
correspond to the user's city location or zip code. 
This is but one of many potential examples of a 
customized response. User profiles can be stored and 
maintained in many locations within the system but 

10 are illustratively stored and maintained with 
communication service provider 510. The profile 
might be specifically created to accommodate the 
dialog-based information retrieval process, or might 
be an existing profile created primarily for a given 

15 dialog interaction scheme (e.g., an instant messenger 
profile) . 

In accordance with another embodiment, 
content server 516 is configured to analyze requests 
for information over time and automatically construct 

20 a user profile for a given user. For example, if a 
user asks for the weather in Minneapolis four times 
within a month, then subsequent generic requests for 
weather will automatically relate to Minneapolis 
until and unless the user indicates that the 

25 assumption is in error. This is but one example of 
many automatic profile assumptions for which the 
system can be configured. 

In accordance with one embodiment, content 
server 516 can be configured to tailor responses to 

30 requests for information to the particular location 



-27- 

from which the request originates. For example, user 
devices 502, 504 and 506 are illustrated as having an 
optional geographic locator component (e.g., a GPS 
application, as is known in the art) stored thereon. 
5 The geographic locator component illustratively 
enables an indication of the location of the 
associated device to be transmitted, for example, 
with a dialog-based request for information. As an 
example of an application of this process, a user 

10 dialogs with a non-human source and asks for the 
weather. The content server collects and returns 
• weather information for the particular location from 
which the request originated. This is but one 
example of the many potential applications of a 

15 geographic locator program within the framework of 
the overall system 500. 

In accordance with one embodiment, 
communication service provider 510 can be configured 
to provide information to a user based on a reading 

20 of circumstances rather than in direct and immediate 
response to a request. For example, a user can 
illustratively dialog with a non-human source and 
direct it to provide information if and when an event 
occurs. For example, a user may instruct that 

25 alternate driving direction be provided if and when 
traffic becomes congested on a particular driving 
route. This is but one of many examples of 
information being provided based on a reading of 
circumstances . 
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In accordance with one embodiment, content 
server 516 is configure to provide a response to 
requests for information in a format appropriate for 
the device from which the request originated. 
5 Alternatively, however, a user can configure the 
system to provide responses in any format, and even 
to devices other than that from which a request 
originated. 

The content retrieval system of the present 

10 invention is advantageous because the required 
client-side framework is minimal and existing. 
Little or no development is required on the client 
side. As the system is updated or added to, only the 
server side requires modification. A standard client 

15 interface is provided, thereby providing a standard 
way to access server content. Further, the system 
enables a user to interact with a content provider 
while they are at their PC or away from it. The 
interaction model is based on a human interaction 

20 model, which increases user friendliness, A user's 
input can even be relatively free natural language 
that is analyzed to glean commands and instructions. 
The content provider is potentially accessible from 
multiples interfaces, including chat, voice and email 

25 interfaces. 

FIG. 6 is a schematic block diagram 
illustrating another dialog-based content retrieval 
system 600. Elements in FIG. 6 that are the same or 
substantially similar to elements illustrated and 
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discussed in relation to FIG. 5 have been given the 
same reference numerals. 

Within system 500, the communication 
service provider (e.g., an instant messaging service 
5 provider, an email transferring service provider, a 
telephone service provider, etc.) hosts the content 
server. Within system 600, one or more content 
providers host the content server. In the latter 
case, requests for content are directed to an 

10 appropriate content server 516 by communication 
service provider 510. The appropriate content server 
516 compiles the information necessary to fulfill the 
request and forwards it to communication service 
provider 510 for transfer to the user who made the 

15 request. 

V. Example of Dialog-Based Content Retrieval 

In order to extend the description of the 
present invention to include additional details, a 
20 specific example of the already described dialog- 
based content retrieval system will now be described. 
The example will assume dialog-based communication in 
the particular form of instant messaging 
communication . 

25 One aspect of the present invention 

generally pertains to a service that enables content 
to be transferred to any device that has an instant 
messaging client on it. It is generally known in the 
art that instant messaging communications can be 

30 initiated by selecting a contact buddy on a buddy 
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list. The content transferred in accordance with the 
present invention is transferred through user 
interaction with a specialized buddy on the buddy 
list. In accordance with one embodiment, the 

5 specialized buddy appears to the user as "My 
Concierge." The service converts user interactions 
with the specialized buddy into searches, which are 
utilized to obtain content that is fed to the service 
(e.g., from various content providers) using XML (or 

10 any other suitable means) . The service uses key 
words to recognize the type of requested content. 
The service generally enables an Internet service 
provider to deliver content to any device that has an 
instant messaging client, for example, over SMS, 

15 Wireless Application Protocol (WAP) , or dedicated 
client, without having additional client or service 
side requirements. The content delivery scheme 
includes a user-friendly, known interface. The 
scheme is positioned to take full advantage of future 

20 instant messaging features, such as voice, video, 
pictures and location. 

A user is able to determine the 
availability of the service by looking at the status 
of his or her specialized buddy (e.g., determination 

25 is made as to whether "MyConcierge" is online, 
offline, busy, etc.). Assuming the specialized buddy 
is available, the user initiates instant message 
communication with the buddy. Once the conversation 
starts, the user illustratively asks questions such 

30 as "What's up?" or "What is...?". The service converts 
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those questions to searches, and eventually, into 
content . 

In accordance with one embodiment, the 
service utilizes key words to recognize a type of 
5 desired service. For example, "What is?" might 
signify that access to a knowledge-oriented service 
(e.g., Encarta by Microsoft Corporation of Redmond, 
Washington) is desired. The knowledge-oriented 

service is assumedly a good source for answering 

10 "What is?" type questions. In another example, 
"Where is?" might signify that access to a 
geographic-oriented service (e.g., MapPoint by 
Microsoft) is desired. 

In accordance with one embodiment, the 

15 service utilizes the existing instant messaging user 
profile and subsequent personalization to establish 
commonly used addresses for a specific user, as well 
as other preferences. The service is also configured 
to interact with the user through the specialized 

20 buddy in instant messaging format to ask 
personalizing questions such as "Where?" and can 
suggest response options such as "Home", "Work", or 
"Other (please enter zip code or city/state)" to 
collect relevant info in order to customize a 

25 response for a given user. 

The service can illustratively be 
configured to use location aware devices and 
networks, when available, to enable a user to ask 
questions with a reference to "Here" as a location. 
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The service then retrieves the current user location 
and provides location aware information. 

FIG. 7 is an illustration of a screen shot 
700 in accordance with one embodiment of the present 
5 invention. The screen shot is intended to 

demonstrate how an instant messaging program can be 
utilized to deliver content. In accordance with the 
illustration, the described specialized buddy is 
listed on the user's (Linda's) buddy list as 

10 "MyMSNConcierge" . The provider of the instant 

messaging system can illustratively deliver content 
to any device that implements the client messaging 
software. In addition, the provider can provide 
content obtained from independent third parties. For 

15 example, XML based extensions to third party 
platforms can be generated to provide server/service 
for content providers. The content, like the 

messaging service itself, can be delivered over SMS, 
WAP, or dedicated client without having additional 

20 client side infrastructure. 

FIG. 8 is an illustration of a screen shot 
800 in accordance with one embodiment of the present 
invention. Screen shot 800 is an example of a 
conversation between a user (Linda) and her 

25 specialized buddy (MyMSN Concierge) . The user can 
illustratively preset preferences like common 
locations and other data of interest. The 
preferences can be saved to the service. 
Alternatively, data can be gleaned through 

30 conversation as the FIG. 8 conversation illustrates. 
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In accordance with one embodiment, a user can enable 
a location selected option, wherein the user can 
select "here" as a location, and the service will 
default to the user's listed preferential location. 
5 By providing shortcut letters (a), (b) , etc. as 
illustrated, the need for text input is minimized. 
Shot 800 shows the box at the bottom where the user 
inputs and enters text, as is known in the art. 

FIG. 9 is an illustration of a screen shot 

10 900 in accordance with one embodiment of the present 
invention. In accordance with one aspect of the 
present invention, shot 900 demonstrates a user' s 
ability to use short commands when communicating with 
their specialized buddy. As is illustrated by the 

15 sample conversation in the FIG. 9 screen shot, 
"directory" stands for access to yellow page 
directory information, "Where is?" stands for access 
to a geographic or map-oriented program for 
information, "What is?" stands for access to a 

20 knowledge-oriented program for information, "What's 
up?" stands for access to basic general information 
content, and "back" takes the user back to his or her 
first request. These are just a few of many 
potential examples of key words that can be assigned 

25 for various purposes. 

It should be noted that creation of a new 
keyword or command is relatively simple because it 
requires nothing to happen on the client side. Only 
the server side must be updated to support new, or 

30 change, keywords. Users can also illustratively 
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customize, create and assign their own keywords or 
commands with relative ease. The user's preferences 
can be saved for them on an individual basis. 

In accordance with one embodiment , if a 
5 user attempts to access a service (e.g., a map 
program, a knowledge-oriented program, etc.) for 
which they are not signed up, the specialized buddy 
sends the user a link to upsell additional services. 

10 

VI. Dialog-Based Task Execution 

In addition to providing content through a 
dialog-based service, the dialog-based service can 
also be utilized to collect instructions from a user 

15 to be executed on behalf of the user. 

FIG. 10 is a schematic block diagram 
illustrating a task execution system 1000. Elements 
appearing in FIG. 10 that are the same or similar to 
elements previously described in relation to other 

20 Figures have been designated with the same reference 
numerals. Generally speaking, system 1000 operates 
in a manner that is substantially similar to system 
500 described above. The primary difference is that 
the user's dialog directed to a specialized buddy is 

25 analyzed to extract tasks to be performed instead of 
content to be retrieved. In effect, the user can 
instruct the specialized buddy to act on his or her 
behalf to pay a bill, make a calendar appointment, or 
perform some other task. In this way, the user is 

30 spared having to access individual applications, and 
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their association user interfaces, in order to 
perform the tasks manually. The task instructions 
identified from the user's dialog (e.g., using a 
keyword system similar to that described in relation 
5 to the content retrieval embodiments) are processed 
by application server 1002 and executed in 
association with user application programs 1004. 
Application programs 1004 might be stored locally 
with communication service provider 510, on the 

10 user's personal computing device or telephone, or in 
a remote network location. 

Accordingly, another aspect of the present 
invention pertains to task-execution based on 
interaction with a dialog-based interface. A user 

15 utilizes traditional dialog-based interaction to 
interact with a non-human entity and request 
execution of a task. The user interacts with the 
non-human entity in a manner similar to how they 
would typically interact with another person. 

20 FIG. 14 is a flow chart illustrating the 

process of a user utilizing a dialog-oriented system 
to execute a task. In accordance with block 1402, a 
user dialogs with a non-human source and requests 
execution of a task (e.g., payment of a bill). The 

25 request is illustratively derived from the user's 
dialog based on a keyword command system similar to 
that described in relation to content retrieval. The 
system can be configured to dialog back and forth 
with the user to ascertain accurate instructions. In 

30 accordance with block 1404, the request is directed 
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to application server 1002. In accordance with block 
1406, a corresponding command is directed to an 
appropriate application 1004. In accordance with 
block 1408, the task is executed. Block 1410 
5 represents an optional step wherein a receipt is sent 
to the user indicating what task was performed and 
when . 

It should be noted that a task-execution 
system and a content retrieval system can be combined 

10 into a single system and presented to a user in a 
uniform manner. It should be noted that task 
execution services could be extended to the user on a 
subscription basis as described in relation to the 
content retrieval embodiments. Also, user profiles 

15 and preferences can be utilized as described to 
customize the task-execution process. Task execution 
can be configured to be triggered circumstantially 
(e.g., pay the bill if it is past May 25, etc.). 

FIG. 11 is a schematic block diagram 

20 illustrating another dialog-based task-execution 
system 1100. Elements in FIG. 11 that are the same 
or substantially similar to elements discussed in 
relation to previous Figures have been assigned the 
same reference numerals. 

25 Within system 1000, the communication 

service provider (e.g., an instant messaging service 
provider, an email transferring service provider, a 
telephone service provider, etc.) hosts the 
application server. Within system 1100, one or more 

30 user applications host an application server. In the 
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latter case, requests for task-execution are directed 
to an appropriate application server by communication 
service provider 510. The appropriate application 
server arranges for execution of the task. 
5 Confirmation of task execution can be forwarded to 
communication service provider 510 and/or the user. 
It is to be understood that task-execution can be 
geographically tailored (e.g., order me a pizza and 
have it delivered here) in the essentially same 
10 manner as was described in relation to content 
delivery. 

It should be noted that email interaction 
could be utilized to support either of the described 
content retrieval and task-execution systems. In 

15 accordance with one embodiment of such a system, a 
user sends an email to a simulated entity in order to 
request content or performance of a task. The email 
service provider includes infrastructure to analyze 
the text of the email (e.g., parsing out information) 

20 sent to the simulated entity and identify key words 
or commands, which may or may not be the same key 
words as utilized in a chat-oriented scenario. The 
commands are executed as described in relation to 
other embodiments. Requested content can be 

25 transferred to the user through email or otherwise, 
depending on the user's preferences. 

Although the present invention has been 
described with reference to particular embodiments, 
workers skilled in the art will recognize that 
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changes may be made in form and detail without 
departing from the spirit and scope of the invention. 



